-
Notifications
You must be signed in to change notification settings - Fork 249
Improve Quantization Setup Prompts and Doc #1537
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/torchchat/1537
Note: Links to docs will display an error until the docs builds have been completed. ❌ 4 New Failures, 2 Cancelled JobsAs of commit 70239cc with merge base 0299a37 ( NEW FAILURES - The following jobs have failed:
CANCELLED JOBS - The following jobs were cancelled. Please retry:
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks, mini nit good good to merge
exit 1 | ||
fi | ||
|
||
if [[ "$LINK_TORCHAO_OPS" == "ON" ]]; then | ||
if [ ! -d "${TORCHCHAT_ROOT}/torchao-build" ]; then | ||
echo "Directory ${TORCHCHAT_ROOT}/torchao-build does not exist." | ||
echo "Make sure you run clone_torchao" | ||
echo "Make sure you run bash torchchat/utils/scripts/clone_torchao.sh" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nit: don't need to specify bash
@@ -149,6 +149,7 @@ From the torchchat root directory, run | |||
bash torchchat/utils/scripts/build_torchao_ops.sh | |||
``` | |||
|
|||
Note that before running it, you must first clone torchao with `bash torchchat/utils/scripts/clone_torchao.sh` if you have not done so already. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
clone_torchao
is called as part of the install_requirements, so it might be better for us to remind users to call that first
The ET failure is a separate pin error that I'm throwing up a fix for |
Currently we don't prompt people to clone torchao first before running
bash torchchat/utils/scripts/build_torchao_ops.sh
. We can improve the prompts and doc similar to what we already have forbash torchchat/utils/scripts/build_native.sh et link_torchao_ops
.cc @Jack-Khuu @byjlw